Looks like there are still a few ruff issues.

You need to run ruff check --fix . on the codebase. I'd be happy to make the change myself, but since your pull request is from the main branch, GitHub does not allow me to push changes to your branch, so you will need to make all the necessary changes to pass the CI checks. Thanks!

The CI now fails on the mypy step. Here's what I suggest as the change to csvparser:

    async def parse(self, content: IO) -> AsyncGenerator[Page, None]:
        # Check if content is in bytes (binary file) and decode to string
        content_str: str
        if isinstance(content, (bytes, bytearray)):
            content_str = content.decode("utf-8")
        elif hasattr(content, "read"):  # Handle BufferedReader
            content_str = content.read().decode("utf-8")

The next CI step is black. You can run black . locally to fix the formatting.

The step after that is running tests. I think those are failing currently as you haven't brought in the current changes from the main branch. There should only be a single line difference in prepdocs.py, the line that adds CSVParser, but it's instead showing many lines changes.

The CONTRIBUTING.md has details about how to run these steps locally, by the way:
https://github.com/Azure-Samples/azure-search-openai-demo/blob/main/CONTRIBUTING.md#submit-pr

The CI now fails on the mypy step. Here's what I suggest as the change to csvparser:

    async def parse(self, content: IO) -> AsyncGenerator[Page, None]:
        # Check if content is in bytes (binary file) and decode to string
        content_str: str
        if isinstance(content, (bytes, bytearray)):
            content_str = content.decode("utf-8")
        elif hasattr(content, "read"):  # Handle BufferedReader
            content_str = content.read().decode("utf-8")

The next CI step is black. You can run black . locally to fix the formatting.

The step after that is running tests. I think those are failing currently as you haven't brought in the current changes from the main branch. There should only be a single line difference in prepdocs.py, the line that adds CSVParser, but it's instead showing many lines changes.

The CONTRIBUTING.md has details about how to run these steps locally, by the way: https://github.com/Azure-Samples/azure-search-openai-demo/blob/main/CONTRIBUTING.md#submit-pr

Thanks

The CI now fails on the mypy step. Here's what I suggest as the change to csvparser:

    async def parse(self, content: IO) -> AsyncGenerator[Page, None]:
        # Check if content is in bytes (binary file) and decode to string
        content_str: str
        if isinstance(content, (bytes, bytearray)):
            content_str = content.decode("utf-8")
        elif hasattr(content, "read"):  # Handle BufferedReader
            content_str = content.read().decode("utf-8")

The next CI step is black. You can run black . locally to fix the formatting.

The step after that is running tests. I think those are failing currently as you haven't brought in the current changes from the main branch. There should only be a single line difference in prepdocs.py, the line that adds CSVParser, but it's instead showing many lines changes.

The CONTRIBUTING.md has details about how to run these steps locally, by the way: https://github.com/Azure-Samples/azure-search-openai-demo/blob/main/CONTRIBUTING.md#submit-pr

Thanks for the code. I added this.
I did formatting with black

Have you made a commit with the changes to run black and to update prepdocs.py to match main? I only see the mypy commit, and CI is still failing.

I've made a few changes to merge this with main, and it's now looking good. I've also tested it locally. It has the same drawback of other files where the browser downloads the CSV instead of rendering it, but that's not unique to the CSV file format. Merging!

Thank you for helping me to push the files in the main.